To Appear in AAAI-08 Workshop on Metareasoning Retrospective Self-Adaptation of an Agent’s Domain Knowledge: Perceptually-Grounded Semantics for Structural Credit Assignment
نویسندگان
چکیده
AI research on meta-reasoning for agent self-adaptation has generally focused on modifying the agent’s reasoning processes. In this paper, we describe the use of meta-reasoning for retrospective adaptation of the agent’s domain knowledge. In particular, we consider the use of meta-knowledge for structural credit assignment in a classification hierarchy when the classifier makes an incorrect prediction. We present a scheme in which the semantics of the intermediate abstractions in the classification hierarchy are grounded in percepts in the world, and show that this scheme enables self-diagnosis and self-repair of knowledge contents at intermediate nodes in the hierarchy. We also discuss the implications of this scheme for an architecture for meta-reasoning.
منابع مشابه
Retrospective Self-Adaptation of an Agent’s Domain Knowledge: Perceptually-Grounded Semantics for Structural Credit Assignment
AI research on meta-reasoning for agent self-adaptation has generally focused on modifying the agent’s reasoning processes. In this paper, we describe the use of meta-reasoning for retrospective adaptation of the agent’s domain knowledge. In particular, we consider the use of meta-knowledge for structural credit assignment in a classification hierarchy when the classifier makes an incorrect pre...
متن کاملPerceptually grounded self-diagnosis and self-repair of domain knowledge
We view incremental experiential learning in intelligent software agents as progressive agent self-adaptation. When an agent produces an incorrect behavior, then it may reflect on, and thus diagnose and repair, the reasoning and knowledge that produced the incorrect behavior. In particular, we focus on the self-diagnosis and self-repair of an agent’s domain knowledge. The core issue that this a...
متن کاملElo Ratings for Structural Credit Assignment in Multiagent Systems
In this paper we investigate the applications of Elo ratings (originally designed for 2-player chess) to a heterogeneous nonlinear multiagent system to determine an agent’s overall impact on its team’s performance. Measuring this impact has been attempted in many different ways, including reward shaping; the generation of heirarchies, holarchies, and teams; mechanism design; and the creation of...
متن کاملMultiagent Metareasoning through Organizational Design
We formulate an approach to multiagent metareasoning that uses organizational design to focus each agent’s reasoning on the aspects of its local problem that let it make the most worthwhile contributions to joint behavior. By employing the decentralized Markov decision process framework, we characterize an organizational design problem that explicitly considers the quantitative impact that a de...
متن کاملA Model-Based Approach to Blame Assignment: Revising the Reasoning Steps of Problem Solvers
Blame assignment is a classical problem in learning and adaptation. Given a problem solver that fails to deliver the behaviors desired of it, the blame-assignment task has the goal of identifying the cause(s) of the failure. Broadly categorized, these causes can be knowledge faults (errors in the organization, content, and representation of the problemsolver's domain knowledge) or processing fa...
متن کامل